Analysis of Sequential Decoding Complexity Using the Berry-Esseen Inequality
نویسندگان
چکیده
This study presents a novel technique to estimate the computational complexity of sequential decoding using the Berry-Esseen theorem. Unlike the theoretical bounds determined by the conventional central limit theorem argument, which often holds only for sufficiently large codeword length, the new bound obtained from the Berry-Esseen theorem is valid for any blocklength. The accuracy of the new bound is then examined for two sequential decoding algorithms, an ordering-free variant of the generalized Dijkstra’s algorithm (GDA)(or simplified GDA) and the maximum-likelihood sequential decoding algorithm (MLSDA). Empirically investigating codes of small blocklength reveals that the theoretical upper bound for the simplified GDA almost matches the simulation results as the signal-tonoise ratio (SNR) per information bit (γb) is greater than or equal to 8 dB. However, the theoretical bound may become markedly higher than the simulated average complexity when γb is small. For the MLSDA, the theoretical upper bound is quite close to the simulation results for both high SNR (γb ≥ 6 dB) and low SNR (γb ≤ 2 dB). Even for moderate SNR, the simulation results and the theoretical bound differ by at most 0.8 on a log 10 scale. Index Terms Coding, Decoding, Large Deviations, Convolutional Codes, Maximum-Likelihood, Soft-Decision, Sequential Decoding
منابع مشابه
A Berry-Esseen Type Bound for the Kernel Density Estimator of Length-Biased Data
Length-biased data are widely seen in applications. They are mostly applicable in epidemiological studies or survival analysis in medical researches. Here we aim to propose a Berry-Esseen type bound for the kernel density estimator of this kind of data.The rate of normal convergence in the proposed Berry-Esseen type theorem is shown to be O(n^(-1/6) ) modulo logarithmic term as n tends to infin...
متن کاملA Berry-Esseen Type Bound for a Smoothed Version of Grenander Estimator
In various statistical model, such as density estimation and estimation of regression curves or hazard rates, monotonicity constraints can arise naturally. A frequently encountered problem in nonparametric statistics is to estimate a monotone density function f on a compact interval. A known estimator for density function of f under the restriction that f is decreasing, is Grenander estimator, ...
متن کاملBerry-Esseen for Free Random Variables
An analogue of the Berry-Esseen inequality is proved for the speed of convergence of free additive convolutions of bounded probability measures. The obtained rate of convergence is of the order n, the same as in the classical case. An example with binomial measures shows that this estimate cannot be improved without imposing further restrictions on convolved measures. Courant Institute of Mathe...
متن کاملAsymptotic Refinement of the Berry-Esseen Constant
For sum of independent and identically distributed (i.i.d.) random variables {Xi}i=1, the Berry-Esseen theorem states that sup y∈< ∣∣∣∣Pr { 1 sn (X1 + X2 + · · ·+ Xn) ≤ y } − Φ(y) ∣∣∣∣ ≤ C ρ σ3 √ n , where σ and ρ are respectively the variance and the absolute third moment of the parent distribution, Φ(·) is the unit normal cumulative distribution function, and C is an absolute constant. In thi...
متن کاملOn the constant in the nonuniform version of the Berry-Esseen theorem
In 2001, Chen and Shao gave the nonuniform estimation of the rate of convergence in Berry-Esseen theorem for independent random variables via Stein-Chen-Shao method. The aim of this paper is to obtain a constant in Chen-Shao theorem, where the random variables are not necessarily identically distributed and the existence of their third moments are not assumed. The bound is given in terms of tru...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- CoRR
دوره abs/cs/0701026 شماره
صفحات -
تاریخ انتشار 2007